Multi-Modal Visual Place Recognition in Dynamics-Invariant Perception Space
نویسندگان
چکیده
Visual place recognition is one of the essential and challenging problems in fields robotics. In this letter, we for first time explore use multi-modal fusion semantic visual modalities dynamics-invariant space to improve dynamic environments. We achieve by designing a novel deep learning architecture generate static segmentation recover image directly from corresponding image. then innovatively leverage spatial-pyramid-matching model encode into feature vectors. parallel, encoded using popular Bag-of-words model. On basis above features, finally measure similarity between query target landmark joint their codes. Extensive experiments demonstrate effectiveness robustness proposed approach
منابع مشابه
Multi-modal Semantic Place Classification Multi-modal Semantic Place Classification
The ability to represent knowledge about space and its position therein is crucial for a mobile robot. To this end, topological and semantic descriptions are gaining popularity for augmenting purely metric space representations. In this paper we present a multi-modal place classification system that allows a mobile robot to identify places and recognize semantic categories in an indoor environm...
متن کاملTowards Condition-Invariant, Top-Down Visual Place Recognition
In this paper we present a novel place recognition algorithm inspired by recent discoveries in human visual neuroscience. The algorithm combines intolerant but fast low resolution whole image matching with highly tolerant, sub-image patch matching processes. The approach does not require prior training and works on single images (although we use a cohort normalization score to exploit temporal ...
متن کاملOmnidirectional Visual Place Recognition using Rotation Invariant Sequence Matching
In this work we develop a visual place recognition system for omnidirectional panoramic images that makes use of their full 360 degree circumferential angle of view. The system builds on our previous variant of the sequence SLAM algorithm to include panoramic image rotation alignment for improved image similarity scoring, and bi-directional query and database sequence matching within a Hidden M...
متن کاملHierarchical Multi-Modal Place Categorization
In this paper we present an hierarchical approach to place categorization. Low level sensory data is processed into more abstract concept, named properties of space. The framework allows for fusing information from heterogeneous sensory modalities and a range of derivatives of their data. Place categories are defined based on the properties that decouples them from the low level sensory data. T...
متن کاملMulti-modal Semantic Place Classification
The ability to represent knowledge about space and its position therein is crucial for a mobile robot. To this end, topological and semantic descriptions are gaining popularity for augmenting purely metric space representations. In this paper we present a multi-modal place classification system that allows a mobile robot to identify places and recognize semantic categories in an indoor environm...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Signal Processing Letters
سال: 2021
ISSN: ['1558-2361', '1070-9908']
DOI: https://doi.org/10.1109/lsp.2021.3123907